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Abstract — This paper is motivated by a sensor network on a 
correlated field where nearby sensors share information, and can 
thus assist rather than interfere with one another. A special class 
of two-user Gaussian interference channels (IFCs) is considered 
where one of the two transmitters knows both the messages to 
be conveyed to the two receivers (called the IFC with degraded 
message sets). Both achievability and converse arguments are 
provided for this scenario for a class of discrete memoryless 
channels with weak interference. For the case of the Gaussian 
weak interference channel with degraded message sets, optimality 
of Gaussian inputs is also shown, resulting in the capacity region 
of this channel. 

Index Terms — Network information theory, Interference chan- 
nel, Dirty-paper coding 

I. Introduction 

An interference channel (IFC), characterized by the channel 
pCj/ifJ/al^ij^)) is one of the basic building blocks of many 
networks and is thus considered a fundamental problem in 
multi-user information theory. The capacity region of this 
channel remains an open problem, with some special cases 
such as the strong-interference case being solved. One of the 
fundamental difficulties faced while attacking the IFC capacity 
problem is that, unlike the broadcast channel, no transmit-side 
cooperation is possible. 

Cooperation among transmitters can improve the rates 
achievable by employing joint encoding, i.e. [1] [2], [3]. As an 
example of this cooperation, Marie, Yates and Kramer consider 
the capacity of the strong interference channel with common 
information [4] and unidirectional cooperation [5]. 

In this work, we consider a two-user IFC where we allow 
limited cooperation between the transmitters by means of 
permitting one of the transmitters to possess the message of 
the other, or in other words, the message sets are degraded. 
Such a cooperative IFC is of interest on its own merit. One 
example of this is shown in Figure |l(a)| in which Sensor 
A has better sensing capability thus can detect both events 
while Sensor B can only detect one of them and the data need 
to be sent to different destinations. In this example, Sensor 
A can potentially improve Sensor B's transmission with the 
additional transmitter side information by cooperation. An- 
other example is shown in Figure [T(b)l W\, Wi is transmitted 
from A to D,E respectively; if the intermediate nodes B, 
C employ a decode-forward coding scheme with an inbuilt 
degraded broadcast channel, then B, C, D, E form an IFC 
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with degraded message sets, where B can cooperate with C 
in transmitting its message. 
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(a) Data collection through IFC 
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(b) Cascaded with degraded broadcast channel 
Fig. 1 . Two applications of interference channel with degraded message sets 

In this paper, we find an achievable region and outer 
bound on the capacity region of the discrete memoryless IFCs 
with degraded message sets. Specifically, for a class of weak 
interference IFCs, this achievable region meets the outer bound 
giving us the capacity region for this class of channels. In 
the specific case of the Gaussian input distribution, we find 
Gaussian inputs to be optimal, resulting in the region being 
characterized in closed form. 

The rest of the paper is organized as follows. In Section ITT1 
the basic definitions are presented and three types of weak 
interference are introduced. The main results are presented 
in Section [HI] including the capacity region of a class of 
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discrete memoryless weak interference channels (and Gaussian 
weak interference channels) with degraded message sets with 
numerical results of the Gaussian case shown in Section [Fvl 
Detailed proofs for Section [HI] are given in Section [V] Finally 
we conclude the paper with Section fVll 

II. Notations and Preliminaries 

A. Channel model and definitions 

We adopt the following notational conventions. Random 
variables (RVs) will be noted by capital letters, while their 
realizations will be denoted by the respective lower case 
letters. denotes the random vector (X m ,..,,X n ), and 
X n denotes the random vector (X x , . . . , X n ). 
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Fig. 2. The model of interference channel with degraded message sets 

A two-user interference channel (IFC) 
(X x ,X 2 ,y x ,y 2 ,P{y x ,y 2 \x x ,x 2 )) is a channel with two 
input alphabets X x , X 2 , output alphabets y±, y 2 and 
transition probability P(y x , y 2 \x x , x 2 ). It is assumed the 
channel is memoryless, namely 

n 

P(y?, y 2 "K, x n 2 ) = [] P(vi,i, Itt,i|aJi,i, xa,i) • 

i=l 

Transmitter t sends a message with M t bits, Wt, to receiver 
t in n channel uses at rate R t — M t /n bits per use. A 
(R x ,R 2 ,n, P e>x ,P ei2 ) code is defined as any code achieving 
the rate pair (R X ,R 2 ) with block size n and decoding error 
probability P e " , t — 1,2. The capacity region Cjfc is the 
closure of the set of rate pairs (R x , R 2 ), for which the receivers 
can decode their messages with error probability P e ( " } -> 
for t = 1,2 as the block size n — > +oo. 

In the classic IFC described above, each transmitter has its 
own message set M t = {W t }, where W t € {1, 2, . . . , 2™'} 
denotes the private message to the receiver t. In the IFC with 
common information, which is proposed recently by Marie, 
Yates and Kramer in [4], each transmitter has not only its own 
private message W t , but also the common message Wo shared 
by all the transmitters. Thus the message set for transmitter t 
is M = {W , W t }. 

In this paper, we consider the interference channel with de- 
graded message sets (IFC-DMS). For a two-user IFC with the 
degraded message sets, the message set of one transmitter is 
a strict subset of the other. For example, Figure |2] corresponds 
to the message sets, 



{W 2 } = M 2 dMi = {Wt, W 2 } , 



(1) 



for which the capacity region is denoted as Cj FC regarding to 
that transmitter 1 knows both messages. On the other hand, 



Cjp C denotes the capacity region of IFC with transmitter 2 
knowing both messages, namely 



{W X } = M X cM 2 = {Wi,W 2 } 



(2) 



In recent work (e.g. [5]), the IFC-DMS has also been 
referred to as interference channel with unidirectional co- 
operation - one transmitter knows the other's message and 
thus can enhance the achievable rate region. The definition of 
degradedness of message sets can be further generalized to 
K-user IFC: the message sets are degraded if there exists a 
permutation {<Jk, k = 1, . . . , K} of {1, 2, . . . , K}, such that 
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In general, the capacity region of an IFC is an open problem 
and only known for certain classes of IFCs which include the 
so-called strong interference channels, which satisfy 



HXuY^Xi) < I(X V ,Y 2 \X 2 ) 
J(X a; y 2 |Xi) <I{X 2 ;Y X \X X ), 



(3) 



for all product distributions on the inputs X\ and X 2 . The 
capacity region in this case coinsides with the capacity region 
of compound IFC which is the union of two compound 
multiple access channels (MACs) determined by Ahlswede 
[6]. Under a strong interference assumption that is (slightly) 
different from Q, given by 



iiXr^x^u) < l{X r ,Y 2 \X 2 ,U) 

I{X 2 ;Y 2 \X X ,U) < I{X 2 ;Y X \X X ,U) , 



(4) 



for all joint distributions P(u, x x , x 2 , y x , y 2 ) that factor 
as P(u)P(x x \u)P(x 2 \u)P(y x , y 2 \x x , x 2 ), Marie, Yates and 
Kramer find the capacity region of strong IFCs with common 
information [4] and with degraded message sets [5]. 

In this paper, we study three different notions of weak 
interference and investigate the capacity region for this channel 
with degraded message sets. These three notions are extensions 
of the concepts of stochastically degraded, less noisy and more 
capable from broadcast channel literature [7]. 

Definition 2.1: The interference channel is said to be type 
A weak interference channel if 



I(X X ;Y 2 \X 2 ) <I(X X ;Y X \X 2 ) 



(5) 



or. 



I(X 2 ;Y X \X X ) < I(X 2 ;Y 2 \X X ) . (6) 
Definition 2.2: The interference channel is said to be type 
B weak interference channel if, for any U,U (X x , X 2 ) — > 
(Y x , Y 2 ) forms a Markov chain, it satisfies 



I(U,X 2 ;Y 2 ) <I(U, X 2 ;Y X ) 



(7) 



or, 



I(U,X X ;Y X ) <I(U,X X ;Y 2 ). (8) 
Definition 2.3: The interference channel is said to be type 
C weak interference channel if there exists a probability 
transition matrix qi(y 2 \x 2 ,y x ) such that 



p(y2\x x ,x 2 ) =^2p(yi\x x ,x 2 )q x (y 2 \x 2 ,y x ) , 



(9) 
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or if there exists a probability transition matrix q 2 (yi\xi, y 2 ) 
such that 



p(yi\xi,x 2 ) 



yi 



p(y2\xi,x 2 )q 2 (yi\xx,y 2 ) . 



(10) 



Note that if the channel input X 2 of IFC is fixed, then the 
channel between X\, Y\, Y 2 forms a broadcast channel. For 
type C weak interference satisfying (|9jl, this broadcast channel 
is stochastically degraded. This broadcast channel is less noisy 
for type B weak interference satisfying (Q, and more capable 
for type A weak interference satisfying [7]. Note that the 
notion of "more capable" is strictly weaker than that of "less 
noisy", which is strictly weaker than "degraded". 

In this paper, we will establish the capacity region of the 
interference channel with degraded message sets in Figure |2 
and type C weak interference. 



Let the capacity region of a Gaussian IFC with degraded 



message sets (i.e., Figure |3(a)) be denoted by Cq IFC . As 
first step, we present an outer bound for Cq IFC . 
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B. Gaussian interference channels 

One of our main interests in this paper is the Gaussian IFC, 
in which the alphabets of inputs and outputs are real numbers 
and the outputs are linear combinations of input signals and 
white Gaussian noise. The Gaussian IFC is defined as follows, 



(11) 



Yi = X± + aX 2 + Z x 

Y 2 = bXi +X 2 + Z 2 

where a and b are real numbers and Z\ and Z 2 are inde- 
pendent, zero-mean, unit-variance Gaussian random variables. 
Furthermore, the transmitters are subject to average power 



constraints: 



1 



N 



lim -^E[X^]<P t . 



t = 1,2. 



(12) 



The capacity region of the non-cooperative Gaussian IFC is 
currently characterized for the cases when a = b = (trivial) 
or if a 2 > 1 and b 2 > 1, in which case the strong interference 
conditions in Q are satisfied. The capacity of IFC for strong 
interference is the set of (Ri,R 2 ) satisfying [8], [9] 



< Ri 


< iioga+po 


(13) 


< R 2 


< i]og(l + P 2 ) 


(14) 


0<Ri 


+ R2 < \ log(Pi + a 2 P 2 + 1) 


(15) 


0<Ri 


+ R2 < ^ log(6 2 Pi + P 2 + 1) • 


(16) 



In the regime when < 



< 1 or < b 2 < 1, the 



Gaussian IFCs belong to all three notions of weak interference. 
Achievable rate regions [9]— [ 11] and outer bounds [10], [12]- 
[14] are known for this scenario, but a characterization of the 
region is yet to be obtained. A recent outer bound by Kramer 
in [14] is given by (Ri,R 2 ) satisfying Jl 31 . dl4t . and 



Ri 



Ri 



R2<1 log 



R 2 <- log 



(P 1 +a 2 P 2 + l)( 



P 2 + l 



min(a 2 , 1)P 2 + 1' 



(P2 



b 2 P 1 



D( 



Pl + 1 



minO 2 , l)Pi + 1- 



(17) 



(18) 



(a) The Gaussian IFC with degraded message sets 




(b) The Gaussian MIMO broadcast channel 
Fig. 3. The Gaussian MIMO BC outer bound for IFC-DMS 



C. Outer bound for Gaussian IFC-DMS 

First, we provide an "intuitive framework" for an outer 
bound on this channel. A formal outer bound follows this 
framework. 

A straightforward outer bound for Gaussian IFC with de- 
graded message sets (see Figure |3(a)j i, Cq IFC , is the capacity 
region of the Gaussian broadcast channel resulting from allow- 
ing full transmitter-side cooperation. One can make an even 
tighter outer bound by using the following arguments: 

i) Removing the interference link from encoder 2 to re- 
ceiver 1 in Figure |3(a)| does not enhance the overall 
capacity region because encoder 2 does not have any 
knowledge of message W\ and thus no cooperation can 
be induced to improve the transmission rate Pi; 

ii) Now allowing full cooperation between the two encoders 
provides us with an new broadcast channel shown in 
Figure |3(b)| which has two transmit antennas and one 
receive antenna at each receiver and an individual power 
constraint at each antenna. 
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Using the existing literature on the capacity region of 
Gaussian multi-antenna (MIMO) BC channel [15]; dirty paper 
coding (DPC) [16] optimizes this outer bound [17] [18]. If, in 
the dirty paper coding strategy, W\ is encoded first and W 2 
second, the rates achieved are given by: 



n^ PC = | (i?i, R 2 ) : for < a < 1 , 
1 



Ri < 2 !og(l + aPi) , 



i? 2 < ^ lo; 



1 - 1 + Pxb 2 + 2|6|V(1 - a)PiP 2 + P 2 



1 + b 2 aP x 



)}• d9) 



The DPC achievable region for the encoding sequence W 2 , 
Wi is 

TZjjpc = |(i? l5 R 2 ) : for < a < 1 , 

«2 < j log(l + f^ 2 + 2|1>|^(1 - o)P!P 2 + P 2 )} . (20) 

It is not hard to see that the capacity region of Gaussian 
IFC with degraded message set in Figure [3(a)] is contained in 
the union of these two regions 



^(3IFC C T^DPC U T^DPC 



TZ 21 



DPC 



We show later in this paper that the capacity region Cq IFC 
under weak interference is indeed equal to TZp PC , and thus, 
even though the outer bound above is in general loose, it 
captures the intuition behind the optimal coding strategy for 
this channel. 

III. Main results 

In this section, we will first give our inner and outer bounds 
for the discrete-memoryless weak interference channel with 
degraded message sets, and then specialize to Gaussian weak 
IFC-DMS and establish its capacity region. 

Define lZi n to be the set of all rate (Ri, R 2 ) such that 



Ri < J(K;Yi)-J(V;tf,X 2 ) 
R 2 <I(U,X 2 ;Y 2 ), 



(21) 



for the probability distribution p(xi, x 2 , u, v, yi,y 2 ) that fac- 
tors as 

p(u, x 2 )p(v\u, x 2 )p(x 2 \v)p(yi, y 2 \xi, x 2 ) . 

The following theorem gives the achievable region of IFC 
with transmitter 1 knowing both messages as in Figure|2]using 
the Gel'fand-Pinsker coding scheme [19]. 

Theorem 3.1: The capacity region of discrete memoryless 
interference channel with degraded message sets as ([0 satis- 
fies 

7? r C Tl 

The proof is based on the Gel'fand-Pinsker coding scheme, 
in which (U, X 2 ) is considered as the random parameters for 
the channel between X\ and Y\ . It is given in Section IV-AI 



The outer bound is stated next. Define 1Z to be the set of 
all rate pairs {R\, R 2 ) such that 

Ri<I{Xi\Yx\X 2 ) 

R2<I{U,X 2 ;Y 2 ) (22) 
R 1 +R 2 <I(X 1 ;Y 1 \U,X 2 )+I(U,X 2 ;Y 2 ), 

for the probability distribution p(xi 7 x 2 ,u, y\, y 2 ) that factors 
as 

p(u,x 2 )p(x 1 \u)p(y 1 ,y 2 \x 1 ,x 2 ) . 

Theorem 3.2: The capacity region of discrete memoryless 
interference channel with degraded message sets satisfies 

C Tl r V 

The proof is provided in Section IV-BI Both Theorem 13.11 
and Theorem 13.21 hold for the general interference channels. 
However, as we can see, there is a gap between the achievable 
region obtained in Theorem 13.11 and the outer bound in 
Theorem 13.21 

Next we put additional weak interference assumptions (type 
B and type C) and consider its capacity region. The key idea 
is to find a rate region, which is the achievable region under 
type B weak interference condition and the outer bound under 
type C weak interference condition, thus the capacity region 
of type C weak interference channels. 

Define the rate region TZ* to be the set of all rate pairs 
R 2 ) such that 



Ri<I{X^Yx\U,X 2 ) 
R 2 <I(U,X 2 ;Y 2 ), 



(23) 



for the probability distribution p(xi, x 2 ,u, yi, y 2 ) that factors 
as 

p(u,x 2 )p(x 1 \u)p(y 1 ,y 2 \x 1 ,x 2 ) . 

For type B weak interference channels, we have the follow- 
ing achievable region, 

Theorem 3.3: The capacity region of discrete memoryless 
type B weak interference channel with degraded message sets 
and that (0 holds, satisfies 

7? r r Tl ' B 

The proof is based on the coding scheme for degraded 
broadcast channel and the sketch of the proof is provided 
in Section IV-CI for completeness. Note since type C weak 
interference channels satisfy also, thus 



7? r r Tl ' C 

/V* ^ Lsj p(j 



(24) 



holds. 

For type C weak interference channels, we can also show 
1Z* is also its outer bound. 

Theorem 3.4: The capacity region of discrete memoryless 
type C weak interference channel with degraded message sets 
and that (|9) holds, satisfies 

IFC — ■ 



The proof is given in Section IV-DI 

Next we will specialize the weak interference channel to 
the Gaussian case. Since Gaussian weak interference channels 
satisfy type C weak interference condition, the capacity region 



5 



of Gaussian weak interference channel with degraded message 
sets can be established by Theorem l3.4l and proving optimality 
of Gaussian input. 

Theorem 3.5: The capacity region of the Gaussian IFC with 
Gaussian inputs and transmitter T\ knowing both messages, 
Cq IFC , when |6| < 1, is the set of all rate pairs (Ri,R 2 ) 
such that, for < a < 1, 



Comparison of rate regions 




Ri < 2 Mi 

R2<\ log ( 1 



b 2 aP 1 



P 1 b 2 + 2\b\^(l-a)P 1 P 2 + P 2 
1 + b 2 aP 1 



(25) 



(26) 



Here h is the vector [b 1], and S is a 2 x 2 co variance with 
diagonal elements equaling (1 — a) Pi and P 2 respectively. 

As we have seen, the capacity region established in The- 
orem 13.51 is exactly equal to the dirty paper region in dl9l . 
i.e., 

r>T\ T~> 12 

U GIFC ~ IX -DPC ' 

when the encoding sequence is Wi, W 2 for the Gaussian BC 
channel. 

By swapping the parameters of two transmitters, the capac- 
ity region Cq 2 ifc can be obtained as the following corollary. 

Corollary 3.6: The capacity region of the Gaussian IFC 
with Gaussian inputs and transmitter 2 knowing both mes- 
sages, Cq'jpq, when \a\ < 1, is the set of all rate pairs 
{Ri,R 2 ) such that, for < /3 < 1, 

.l + P 1 +2|a| A /(l-/3)PiP 2 +a 2 P 2 ^ 



R 



1 , 
< - log 
~ 2 e 

1 



1 + a 2 (3P 2 



(27) 



R2 < 2 log(l 



(3P 2 



IV. NUMERICAL RESULTS 

In this section, we compare the capacity region of Gaussian 
IFCs with degraded message sets with the outer bounds of the 
normal Gaussian IFCs and the rate regions of Gaussian BC 
channels by numerical results. 

We consider the symmetric Gaussian interference channel 
with Pi = P 2 = 6 and a 2 = b 2 = 0.3. The rate units are 
bits per channel use. First we compare the capacity region 
of GIFC-DMS, Cq'jpq with the dirty paper coding regions 
R% PC in (G]0, WjjpQ in (|20) and the outer bound of GIFC in 
(O - (HU. As we can see, the capacity region of GIFC-DMS 
is strictly larger than the outer bound of GIFC, and the gap 
between these two shows the performance improvement by 
allowing encoders to cooperate partially. The point when a = 
corresponds to the full cooperation between two encoders 
to transmit message W 2 . 

On the other hand, the capacity region of GIFC-DMS can 
be served as the outer bound for GIFC. Since both Cq\ fc and 
Cq'jpq include the capacity region of GIFC, we have 




Fig. 4. The capacity region of Gaussian IFC-DMS with Pi = P2 
a? = b 2 = 0.3 and achievable rate regions of Gaussian BC and IFC 



In Figure [5J we compare some known outer bounds for two- 
user Gaussian IFC for the same setup. As we can see, Kramer's 
outer bound in [14] meets our outer bound of dZ8t > at point A, 
B, and performs better than ours elsewhere. Our outer bound 
in d28i gives a better bound than Carleial's when a and j3 in 
d25t J26l ( l27l is close to 1. 

Note the outer bounds d!7i . dl 8i are proved based on 
a genie-aided argument,or more precisely "receiver genie- 
aided", in which some genie provides additional channel 
output to one of receivers. In contrast, our approach here can 
be viewed as "transmitter genie-aided" in the sense that some 
genie gives additional information of channel input to one of 
the transmitters. We comment that the outer bound by d28t is 
not as good as the one obtained in [14]. However, the bound 
in d28l might be possibly improved when one transmitter only 
knows partial information of the other message instead of the 
full message: for example, in Figure [2] transmitter Ti only 
know g(W 2 ) instead of knowing W 2 , where g(-) is some 
function of W 2 . 



V. PROOFS 



Cqifc c Cqjpq n Cqjpq 



(28) 



A. Proof of Theorem 13.71 

The coding scheme is a straightforward application of 
Gelfand-Pinsker coding. 

Code Generation: Fix p(u,x 2 ), first generate 2 nR2 inde- 
pendent codewords of length n at random according to the 
distribution n™=i P( u ii x 2,i) for message w 2 6 {1, . . . ,2 nR2 }. 
Then generate 2 nI< - V ' Y ) — e i.i.d. sequences v n according 
to the distribution J|™ =1 p(«i),and distribute these sequences 
uniformly into 2 nRl bins. For each sequence v n , let i(v n ) 
denote the index of the bin containing v n . 

Encoding: Encoder 2 transmits X 2 (w 2 ). With wi and 
w 2 , Encoder 1 looks in bin wi for a sequence V n that 
(X™,V n (wi),X2(w 2 ),U n (w 2 )) is jointly typical and sends 
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Fig. 5. The outer bounds of two-user Gaussian interference channel with 
Pi = P 2 = 6, a 2 = b 2 = 0.3: (a) the capacity region Cj^, c ; (b) the 
capacity region Cjp C ; (c) Carleial's outer bound in [13]; (d) Kramer's outer 
bound in [14] (theorem 1). 



X\ ,i. If no such a sequence, an error is declared. If the 
number of sequences in each bin is larger than 2 I ^ U ' X2 ' V \ 
the probability of finding no such U n decreases to as n goes 
to +oo. 

Decoding: Receiver 2 determines the unique W 2 such that 
(U n (W 2 ),X2(W 2 ),Yf) is jointly typical. Receiver 1 looks 
for the unique V n such that (V",Y 1 n ) is jointly typical and 
estimate the message Wi as the index of the bin containing 
the obtained V n . 

At Receiver 1, if 

Ri<I(V;Y 1 )-I{V;U,X 2 )-e, 

the probability of error of wi decreases exponentially to zero 
as n — > 00. The probability of error of w 2 at receiver 2 goes 
to zero as in +00 if R 2 < I(U, X 2 ; Y 2 ). 



B. Proof of Theorem 13.21 

Theorem 13. 21 can be proved by adapting Marton's BC outer 
bound. For a {Ri, R 2 , n, P^i, P e n 2 ) code with decoding error 
Pei ^ as n ^ +00, we define the auxiliary random 
variable U, 

(29) 



Ui - (W 2 , Yl 1 , Y 2i+1 , X 2 1 , X 2i+1 



Applying Fano's inequality [20] for each message W t , t = 
1,2, we have 

H{W t \Y t n ) < nR t P^ + fc(P#) = ne[ n) , (30) 



where e { t n) -> as P^ -> 0. Mor eover, because transmitter 2 
has no information about the message W\, X 2 is independent 
of W\ or the following relation holds 

H{W!\W 2: X r 2 l ) = H(Wi). (31) 

To prove the converse, we need following lemmas: 



Lemma 5.1 ( [21]): For any random variable T, the follow- 
ing equality holds, 

n 

£/(^ +1 ;Yi,i|>r\T) 

i=l 

n 

= ^/(rr 1 ; y 2 ,|K 2 ';. i+ i^)- ( 32 > 

First let prove the outer bound for R\ in \22\ . 

nR 1 < I(Wi;Y"\X 2 ) + ne[ n) (33) 

n 

= J2l(Wi- 1 Y 1 , l \Yr\X^ > 



1=1 



n 

< ^H{Y lti \X 2ii ) -H(Y lii \X$ > Yt 1 ,X 1> 

i=l 



(n) 

- ne\ 



n 

<^/(X liI ;Y 1 , 4 |X 2 , l )+^" ) . 

i=l 

Next we prove the outer bound for R 2 in J22> : 



iR 2 < I{W 2 -Y 2 n )+ne 



n) 



(34) 



It 

<J2HW 2 ;Y^\Y 2 n l+1 ) 

n 

<J2 T ( w ^ Y w Y ^) 

i=l 
n 



(n) 



.(») 



2 > 



i=l 



where (1331 and (I34i are from Fano's inequality in (I30> 
Then we prove the outer bound for the sum rate i?i + R 2 



in ( 122 

n(Ri + R 2 ) 



< HWnYTlW^XS) + I(W 2 ;Y 2 n ) + ne^ + ne ( 2 n) (35a) 

n 

< ^liW^Y^W^X^Yl- 1 ) + I(W 2 ;Y 2ti \Y 2 n ti+i : 



(n) (n) 

- ne\ + ne 2 



n 

< Y(l(W i; Y hi \W 2 , Yr\Y- l+1 ,XZ) 

i=l 

+ I(Y 2 n l+1 ;Y 1 , l \W 2 ,Y*-\X 2 l ) 
+ I(W 2 ,Yr\Y 2 n l+1 ,X2;Y 2 ^) 

+ HYt 1 ; Y 2 ,i\W 2 , Y 2 n l+1 , X%) + ei n) + e 2 n) ) (35b) 

n 

< (l(W i; Y^Ui, X 2;i ) + I(Ui, X 2 ^- Y 2ti 



(n) . (n) 

■ ne\ + ne 2 



n 

< Y^(l{Xi\Y Xti \Ui,X it d + I{U U X 2X , F 2|i )) 

i=l 



(n) (n) 

■ ne\ + ne 2 



(35c) 



(35d) 
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Note ( I35al is due to Fano's inequality in J30I and the 
conditional entropy relation in ( 13 U : the two terms in ( I35bl 
are equal due to Lemma 15.11 ( I35ci is obtained by using 
the auxiliary random variable Ui and (I35di is true because 
(Wi, Ui) -> X 2 ,i) -> y 2 ,i) forms a Markov chain 

in this order for all 1 < i < n. 

C. Proof of Theorem \3.3\ 

Here we provide a proof for Theorem 13. 3 1 the achievability 
of 1Z* for type B weak interference. 

Code Generation: Fix p(u, ir 2 ), generate 2 nR2 independent 
codewords of length n at random according to the distribu- 
tion Yli = iP(ui, X2,i) for message u> 2 € {1, . . . , 2 nR ' 2 }. For 
each codeword (U n (iV2), X^iw^)), generate 2 nRl indepen- 
dent codewords X(wi,w 2 ) according to Yi7=i P( x i l M ' x ?)> 
where w x G {1, ... ,2 nRl }. 

Encoding: Encoder 2 transmits X 2 (iu 2 ). Since encoder 1 
knows both messages, it sends X\(wi,W2). 

Decoding: Receiver 2 determines the unique W2 
such that (U n (W2),X2(W 2 ),Y 2 ) is jointly typical. 
Receiver 1 looks for the unique (Wi,W2) sucn that 
{X?(W u W2),X2(W 2 ),U n (W 2 )) is jointly typical. 

It is easy to see that the probability of error at receiver 2 
goes to zero as n — > +00 if R2 < I(U, X2; Y2). Receiver 1 can 
decode W2 successfully as n — > +00 if R2 < I(U, X2',Yi). 
For type B weak interference with |7}, 

R2 <I(UX 2 ;Y 2 ) <I(UX 2 ;Y 1 ). 

Thus receiver 1 can decode W2 as long as receiver 2 can do 
so. With the error probability of W2 going to zero as n — > 
+00, the error probability of at receiver 1 goes to zero if 
Ri < I(Xx;Yi\X2,U), The above analysis shows that both 
receivers can decode with total probability of error going to 
if (1231 is satisfied. Hence there exists a sequence of good 
codes with error probability going to 0. 

D. Proof of Theorem 13.41 

For the proof of Theorem 13.21 the key is to identify the 
auxiliary random variable and utilize the definition of type B 
weak interference. 

For any (i?i,i?2,n-,P e (n 1 ) ,F e ( 2 ) ) code with decoding error 
P^ 1 ) — > as n — > +00, to prove the outer bound in 1231 for 
Ri, we consider 

nRi = H{Wi) 

< J(Wi ;*?*)- ne£ n) (36a) 

< I(W X ; Y? I W 2 , X 7 2 l ) - nef* (36b) 

n 

<2 J(Wi;Fi >i |W 2 ,y 1 < - 1 ,X?) -ne { ™ ] (36c) 

i=l 

where the inequality ( I36ai is due to Fano's inequality d30t ; 
( I36bi follows from ( 13 It and ( I36ct is due to the reason that the 
mutual information will be increases by adding conditionals. 



Define U { = {W 2 , Y{ _1 , Xlf 1 ), 

n 

nRi <J2l(Wi;Y hl \U l7 X 2 ^X^ +1 )+ne[ n) 

n 

= J2(H(Yi,i\U i ,X2,i,X% i+1 ) 
i=i 

- H(Y lii \U i ,X 2ti ,X2 !i+1 ,W 1 )) +ne[ n) (36d) 

n 

<^2{H{Y lti \Ui,X 2 ,i) 

i=l 

- H (Y lti \Ui, X 2 ,i, X 2 " ii+1 , W 1( X M ) + e< n) ) (36e) 

n 

= ^(i?(yi, i |C7 i ,x 2 , i ) 
i=i 

-H(yi, i |i; i ,X M ,X 2ii )+ei n) ) (36f) 

n 

= ^(/(X 1 , i ;y lii |C/ i) X 2ii ) + e^ 3 ) (36g) 

i=l 

(I36et is because the entropy increases when dropping some 
conditionals and it decreases by adding more conditions. The 
equality ( 136ft is true because W\ — (Xi t i,X 2 ,i) — Yi,i forms 
a Markov chain. 

Now for the bound of R2 in ( I23t . we have 

nR 2 = H(W 2 ) 

<I(W 2 ;Y 2 n )+ne ( 2 n) (37a) 

n 

= ^7(W 2 ;y 2 , i |yr 1 )+ne(" ) 

i=l 
n 

< ^(ff(y 2)< ) - H(Y 2ti \Yt 1 , W2,Xl) + e 2 n) ) , 

i=l 

(37b) 

where ( I37at follows from Fano's inequality in d30t : ( I37bt is 
because the entropy will decrease when adding conditionals. 

Note for the interference channel two receivers cannot 
cooperate, the capacity region is the same as the one with 
the same marginal output p(yi\xi,X2), p(j/ 2 |a;i, x 2 ). Thus for 
type B weak interference satisfying Q, given X 2 , one can 
construct a Markov chain, namely, 

Xx -» Yx -» y 2 . 

Thus the conditional entropy in ( I37bt satisfies 

^(y^iyr 1 ,^,^!) 

^^(y^ly/- 1 ,^,^*) (38a) 

= jr(Y2,i|ai,X 2 , i ) (38b) 

Combine (I24t and ( I37bt . (I38bt . we get the result in Theo- 
rem El 

E. Proof of Theorem 13.51 

Achievability: The achievability of this rate utilizes the 
now famous dirty-paper coding strategy. First, we generate 
a codebook of 2 nR2 codewords according to Af(0, £), where 
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£ is the covariance between transmitter 1 and 2. Transmitter 
1 devotes (1 — a) fraction of its power Pi to the transmission 
of W2, while Transmitter 2 devotes its entire power P 2 to this 
effort. This leads to a covariance of the form 



(1 - u)Pi 1 
1 P2 



(39) 



The effective interference seen by Receiver 1 is a combi- 
nation of the signals communicated from both Transmitters 1 
and 2. Since Transmitter 1 knows the exact realization of the 
message w 2 S W 2 , it has non-causal side information on the 
interference and can completely cancel it out, achieving a rate 



Ri = ilog(l + aPi] 



(40) 



using a Gaussian codebook with codewords that are correlated 
with the interference. At Receiver 2, this Gaussian codebook 
for W\ is perceived as additive interference, hence achieving 
a rate: 



R2 



ilog(i 



KEh* 



1 + b 2 aPi 



(41) 



Maximize R2 over I7I 2 < (1 — atyPiPs (such that £ is positive 
definite), it is not difficult to shown R2 obtain the maximum 
when 7 = — a)PiP 2 and (I26> can be achieved. 

Converse: Since Gaussian IFCs with degraded message 
sets and \b\ < 1 satisfy the condition (|9jl for type C weak 
interference, the outer bound (I23> holds. The central feature 
here is to prove the optimality of Gaussian input. 

To prove the Gaussian optimality, we need following lem- 
mas: 

Lemma 5.2 (Lemma 1 in [22]): Let X\, X2, ■ ■ ■ , Xj~ be an 
arbitrary set of zero-mean random variables with covariance 
matrix K. Let S by any subset of {1,2,..., k) and S be its 
complement. Then 

h(X s \X § )<h(X* s \X* s ), 

where 

{x;,x;,...,xz)~N(p,K). 

Lemma 5.3: Let Xi,X 2 be arbitrarily distributed zero- 
mean random variables and X*,X 2 be zero-mean Gaussian 
distributed random variables with the same covariance matrix 
as Xi, X2, then 

E[X,X 2 ] < (E[(E[X 1 *|X*]) 2 ]E[(X*) 2 ]) 1 
Proof: Using Cauchy inequality and the properties of 
conditional expectation, 



E[X 1 X 2 



■[X 1 X 2 ] 



E[E[X*JC||X|] 



= E[E[XZ\X*]X 2 *] 

(e[{e[x'*\x;}) 2 ] e[(x 



< 



*\2- 



Let denote X'( , X% , U* are Gaussian distributed random 
variables with the same covariance with Xi,X2,U, and 



Var(()A\B) denotes the conditional variance of A given B, 
namely, 

Var{A\B) = E[A 2 |S] . 

First we note that 

0<h(Y 1 \U,X 2 ) 
= h{X 1 +aX 2 + Z 1 \U,X 2 ) 
= h(X 1 + Z 1 \U,X 2 ) 

< h(Xi + Zi) 

< ilog(l + Px). 

Without losing any generality, we can assume 

1 



h{Y l \U,X 2 ) = -log(l+oFL), 
for some a, < a < 1. Thus we have 



(42) 



I(X 1 ; Yi I U,X 2 ) = h(Y 1 \U,X 2 )- h{Y 1 \U, X u X 2 ) 

= \\og{\ + aP 1 ) (43) 



On the other hand, by Lemma 15.21 the conditional entropy 
is upper bounded by the Gaussian variables with the same 
covariance matrix, thus, 

h(Y 1 \U,X 2 ) < h{X x + Z x \X2) 
< h{Xl + Zx\X*) 

= ±log(l + Var(X*\X;)). 

Combining with J42l >. we have a lower bound for 

Var{Xt\X^), 



Var{Xt\X%) > aPi 



(44) 



Note 



Var{Xl\X* 2 ) = E[(X*) 2 } E[(E[X*|X*]) 2 ] , 
together with (I44t . we have 

E[(E[X*\X2*}) 2 ] < (1 - a)P 1 . (45) 
Combine Lemma l5~3l and J45L 



l[XiX 2 ] < ^(1 - a)P!P 2 . 



Thus 



h(Y 2 ) = h(bX 1 + X 2 + Z2) 

< i log(l + b 2 P x + P 2 + 2bE[X 1 X 2 ] 



< - log(l + 6 2 Pj + P 2 + 2by/(l - a)P 1 P 2 ) . (46) 

At last we need to bound h(Y 2 \X2,U). Define Y{, Y 2 ' as 
follows, 

Y{ = X 1 + Z 1 
Y 2 ' = bX x + Z 2 . 
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Thus Y 2 ' is a stochastically degraded version of Y{, or in other 
words, Y% = bY[ + Z', where Z' is Gaussian distributed with 
variance 1 — b 2 . By entropy power inequality (EPI) [20], 

> 2^h(bYl\X 2 ,U) , 2^h(Z') 
= b 2 2 2h(Y 1 \X 2 ,U) + 

= 1 + b 2 aP 1 , 

thus 

h(Y 2 \X 2 , U)>- log(l + b 2 aP x ) . (47) 
And finally we combine (146 \ and (1471 . 

I(X 2 ,U;Y 2 ) 
= h(Y 2 ) - h(Y 2 \X 2 ,U) 

Since g3) (^3} are similar to l|25} (|26}, the optimality of 
Gaussian inputs is established and the proof for converse is 
complete. 

VI. Conclusions and Future Work 

In this paper, we investigate the capacity region of two- 
user interference channel (IFC) with degraded message sets 
(DMS), in which one transmitter knows both messages. For the 
general discrete memoryless interference channel setting, we 
find an achievable region and outer bound, which meet under a 
weak interference condition. Thus, we determine the capacity 
region of a class of channels that includes the Gaussian weak 
interference channel. 

Possible extensions to this work include: 

i) Lossy functions of the message (w 2 ) made available to 
T\ rather than the message itself. This might possibly 
yield a better outer bound for the non-cooperative IFC. 

ii) Generalizing this approach to IFC with more than two 
users in the system. 
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